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DEFECT INSPECTION METHOD 
FOR THREE-DIMENSIONAL OBJECT 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The. present invention relates to an improved defect inspection method of 
a three-dimensional shape. 

2. Description of the Related Art 

As a method of detecting surface defects of a three-dimensional work, for 
instance, Japanese Unexamined Patent Application Publication No. 10-10053 
discloses a method of detecting a defect based on a change or a deferential at the 
boundaries of patterns by irradiating striped-pattern beams on the work. 

However, this method detects the presence or absence of defects based 
simply on changes in the brightness on the work. Thus, it is difficult for the 
method to detect defects on the surface of work that can form shadows due to 
complex projections or recessed shapes or that have different shades due to oil 
contamination or marking made by a marker. This method often produces false 
alarms by detecting normal marks caused by oil contamination or markings made 
by a marker as defects. 

In order to solve such a problem, defect inspection methods have been 
invented which use the three-dimensional shape of an object being inspected in 
accordance with known trigonometric measurement principles. 
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The principle of a defect inspection method using a three-dimensional 
shape based on trigonometric measurement principle is explained briefly with 
reference to Fig. 6(a). 

A light projector 1, for example, a laser beam, emits a beam which is 
directed by a mirror 3 to linearly irradiate a work 2 with a pattern having a width 
in the thickness direction (X-axis direction) of Fig. 6(a). A mirror driving means 
(not shown in the figure) rocks the mirror 3 at a predetermined pitch in a direction 
which moves the locus of radiation orthogonal to the linear irradiation, in other 
words, in a direction which moves the radiation in the right-to-left direction 
(Y-axis direction) of Fig. 6(a). A rotating position detecting means (not shown in 
the figure) detects the rocking position of the mirror 3. A camera 4 takes a picture 
of the work 2 at each rocking position of the mirror 3 by maintaining a 
predetermined relative position with respect to the mirror 3. An image processing 
unit 5 finds the projection/recess shapes of the work 2 by storing a value 
(mentioned as a distance code hereinafter) indicating the rocking angle of the 
mirror 3 for a matrix of laser beam detecting positions in a camera coordinate 
system of the camera 4 for which the linear direction of the irradiation and the 
moving locus of radiation are two orthogonal axes. 

A line Ll(a) shown in Fig. 6(a) is the optical path of the laser beam that 
is reflected by the mirror 3 to irradiate the work 2. A line L2 is a straight line 
connecting the point on the work 2 irradiated by the laser beam to the camera 4. 

The position of the mirror 3 relative to the camera 4, in other words, the 
length of the straight line connecting the mirror 3 and the camera 4, remains 
constant. An angle between the straight line connecting the mirror 3 and the 
camera 4 and the line LI is easily found given knowledge of the rocking angle of 
the mirror 3. 
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An angle between the straight line connecting the mirror 3 and the camera 
4, and the line L2 is calculated as an angle between the line L2 and the optical axis 
of the camera 4 on the basis of the detected laser beam position on a camera 
coordinate system of the camera 4. 

Accordingly, although it is possible to find the distance between the camera 
4 and the work 2 in accordance with the trigonometrical measurement principle, 
the computation is complex and requires a long time for computation. Thus, 
instead of calculating the distance between the camera 4 and the work 2, the 
rocking angles of the mirror 3 which are related to the distances, are stored as a 
corresponding matrix of a laser beam detecting position on a camera coordinate 
system of the camera 4. Therefore, the shape of the work 2 is stored and the need 
for a complex computation is omitted. 

For instance, if it is assumed that a matrix (X, Y) on a camera coordinate 
system for which the linear direction of the irradiation and the moving locus 
direction of the irradiation are two orthogonal axes consists of n-row by m-column 
matrix elements (i„ j,) to (i, _L). Then, if the rocking angle of the mirror 3 is a 
when the irradiated beam is detected at (X (x = l ton> j) on the camera coordinate 
system as shown in Fig. 6(a), the a value is stored in all of the n matrix elements 
in the X-axis direction of the matrix (X (x ^ Y to n) , j) on the camera coordinate 
system. It is found that the height of the work 2 (shown only with a solid line) is 
the same at a section where radiation hits, since the a value is constant. 

If there is a protrusion 2f (as shown with a chain line in Fig. 6(a)) at the 
location (i, j) on the surface of the work 2, the irradiation does not hit the top face 
of the protrusion 2f when the rocking angle of the mirror 3 is a Irradiation hits 
the top face of the protrusion 2f when, for example, the rocking angle of the mirror 
3 is <x\ Thus, the a 1 value is stored only at the position of the protrusion 2f; which 



Patent 4 M2013-43 

is (i, j), among the n matrix elements in the X-axis direction of the matrix (X (x = } 
to n) , j) on the camera coordinate system Accordingly, the existence of the 
protrusion 2f on the work 2 is confirmed based on a difference between the 
rocking angles a and <x\ 

The processing unit 5 repeatedly executes the above-mentioned processing; 
that is the rocking angles of the mirror 3, in other words, distance code values are 
stored at each rocking position of the mirror 3 for a matrix of a laser beam 
detecting positions in the camera coordinate system of the camera 4 while the 
mirror 3 is rocked to shift the radiation in the Y-axis direction. 

Fig. 7(a) is one example of an image when a distance code value on each 
matrix is shaded and visualized by making a distance code value stored at each 
matrix element correspond to a gray-scale density. For instance, the distance code 
value is 0 (black on a gray scale) when the irradiation is at the right end of the 
work 2, and the distance code value is 255 (white on a gray scale) when the 
irradiation is at the left end of the work 2. Such an image is referred to as a 
distance code image hereinafter. 

When a surface defect of the work 2 is detected based on such a principle, 
the projection/recess shape of the perfect work 2 is first found by the image 
processing unit 5. Then, the distance code image of the perfect work 2 is obtained 
as shown in, for instance, Fig. 7(a). The distance code image is mentioned as a 
distance code image as a reference. 

Subsequently, the projection/recess shape of the inspected work 2 is 
similarly found as described above by the image processing unit 5, thus obtaining 
a distance code image of the inspected work 2. Fig. 7(b) is an example of a 
distance code image obtained from the inspected work 2 having a defect 6 at the 
center. 
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Then, the presence/absence of a defect on the inspected work 2 is 
determined by a comparison at each matrix element (ix (x -i ton)J y (y=i tom)) between 
distance codes stored in a reference distance code image obtained from the perfect 
work 2, and distance codes stored in a distance code image obtained from the 
inspected work 2. 

Specifically, a reference distance code image as shown in Fig. 7(a) is first 
compared with a distance code image as an inspection object shown in Fig. 7(b) 
to find a difference of distance codes at each matrix element (i x(x =n 0 n> jy(y=itom))- 
This difference is stored for each matrix element (i* (x = ! to n> j y ^ = } to m) ). As the 
scale of a difference of distance codes is visualized as a corresponding gray-scale 
density, as described above, an image shown in, for example, Fig. 7(c) is obtained. 
Such an image is referred to as a differential distance code image hereinafter. 

Furthermore, as image processing is carried out for the differential distance 
code image by eliminating noise or the like, the defect 6 becomes visible and the 
presence/absence of a defect on the inspected work 2 is easily determined. Such 
an image is mentioned as a defect extracting image hereinafter. 

As such a method is applied, the presence/absence of a defect is determined 
based on an absolute difference in projection/recess shapes of the surface of the 
work 2. Thus, a defect is properly detected while significantly reducing negative 
effects due to a change in density of the image which is caused by shadows on the 
work 2, oil contamination, markings made by a marker, or the like. 

However, in the trigonometrical measurement principle, the rocking 
position of the mirror 3 has to be controlled with high precision. If there is a slight 
error in the rocking position of the mirror 3, a serious error is found in distance 
codes relating to the surface shapes of the work 2. 

Subsequently, the reasons why such a problem is found will be explained 
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briefly by referring to Figs. 8(a) to 8(e). Fig. 8(a) is an example of a shape of the 
work 2 where a distance code image is obtained. The work 2 has a peripheral 
groove 2a having a rectangular cross-section at the outer periphery and a 
peripheral groove 2b having a wedge-shaped cross-section. The work 2 has a flat 
part 2c that is curved in a recessed shape at the center thereof. 

A- A* in Fig. 8(a) shows the linear direction (X-axis direction) of laser 
beams irradiated from the mirror 3, and B-B' indicates the direction (Y-axis 
direction) of a moving locus of radiation. 

Only the flat part where the linear direction (X-axis direction) of radiation 
on the work 2 overlaps with the line B-B 1 is focused upon, and Fig. 8(b) shows the 
data of relations between matrices of laser beam detecting positions and distance 
codes at a reference temperature (for instance, 1 5 ° C). In Fig. 8(b), while distance 
code 0 is a reference value at the right end of the work 2, distance code 255 is a 
reference value at the left end of the work 2. The data is visualized to horizontally 
locate these values. 

The height of the work 2 is always constant in this example without 
depending on where beams radiate on B-B 1 , in other words, which rocking position 
the mirror 3 has. Thus, the graph in Fig. 8(b) is flat with a constant Z value where 
the direction of a moving locus of radiation (Y-axis direction) is the horizontal axis 
and the height of the work 2 is the vertical axis (Z-axis direction). 

Fig. 8(c) shows relations between matrices of laser beam detecting 
positions and distance codes when the same work 2 is measured at a temperature 
higher than the reference temperature. As clearly shown in Fig. 8(b) and Fig. 8(c), 
in the distance code data measured at the temperature higher than the reference 
temperature, the reference values of distance codes are adjusted so as to provide 
the same height at the right and left ends of the work 2. However, as radiation 
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shifts toward the right side (+ direction of Y-axis) of the work 2, incorrect 
measurement results are obtained as if distance codes values gradually increase. 

This is an abnormality of measurement due to the error of rocking positions 
of the mirror 3 mentioned above. For instance, it is assumed that, in Fig. 6(b), the 
5 mirror 3 moves to 3b instead of 3a as a correct rocking position, due to a 
positional error caused by the temperature rise. If the mirror 3 is at the correct 
position 3a to irradiate the laser beam along the line LI and the camera 4 can 
W capture the laser beam at the position (X (x = l ton) , j) on the camera coordinate 

p system, the rocking angle of the mirror 3, in other words, the distance code *** 

10 value, corresponds thereto and is stored. 

y i 

^ However, the mirror 3 is actually displaced to 3b. Although laser beam is 

W 

\\ irradiated along the line LI' and detected at (X (x = x ton> j + Aj) on the camera 

j\ coordinate system, the image processing unit 5 itself does not recognize it and 

W determines that the laser beam irradiated along the line LI is detected at (X (x= x to 

Q 

ill I 5 n) ,j + Aj) on the camera coordinate system. As a result, the image processing unit 
5 stores the distance code a corresponding to a rocking angle, which should have 
been primarily stored at (X (x = x to n) , j) on the camera coordinate system, at the 
position of (X (x= } ton) , j + Aj) on the camera coordinate system (position where a 1 
should have been stored as a primary distance code). Accordingly, an incorrect 
20 measurement results as shown in Fig. 8(c). In other words, the a distance code 
which is larger than the primary a 1 distance code, is stored at the position to the 
right end on the camera coordinate system, so that a contradiction, as shown in 
Fig. 8(c), is found. Moreover, as clearly shown in Fig. 6(a), it is determined that 
the height of a surface is higher at a section with a smaller distance code (a 1 < a) 
25 at each matrix position on the same line with the same Y on the camera coordinate 
system, for example, at (X (x » , ton) , j). 
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Fig. 9(a) shows an example of a distance code image formed on the basis 
of distance codes which are measured at a temperature higher than the reference 
temperature. The distance code image shown in Fig. 9(a) is compared with the 
distance code image prepared at the reference temperature shown in Fig. 7(a) to 
find differences of the distance codes. Then, a differential distance code image as 
shown in Fig. 9(b) is obtained. As clearly shown in Fig. 9(b), the difference values 
become large toward the right side (+ direction of the Y-axis) of the differential 
distance code image due to the above-mentioned distance code error. When a 
defect extracting image is formed based on the differential distance code image, an 
area having large differences remains at the right side (+ direction of the Y-axis) 
section where no defects primarily exist. This section is extracted as a defect, so 
that the work 2 that is primarily a good product, is determined to be an inferior 
product. 

As a method to solve such a problem, distance code images are prepared 
as references at various temperatures, and the reference distance code images are 
chosen depending on the temperature under which an inspection is performed. 

However, in order to prepare a plurality of distance code images as 
references, the image processing unit 5 must have a large memory. Moreover, due 
to temperature changes depending on time even in the same day, distance code 
images as references have to be repeatedly re-selected within the same day and 
measurement procedures become troublesome. 

On the contrary, temperature could be kept constant by controlling the 
measurement environment. However, in this case, the equipment required for 
temperature control is large, which is troublesome. 



OBJECTS AND SUMMARY OF THE INVENTION 
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Accordingly, it is an object of the present invention to solve the 
conventional problems mentioned above, and to provide a defect inspection 
method of a three-dimensional shape that can accurately inspect defects on a work 
surface without changing the settings in accordance with temperature changes, and 
without actively controlling the temperature of the environment. 

The defect inspection method of a three-dimensional shape according to 
the present invention provides a light projector emitting a laser beam, a mirror to 
reflect the laser beam from the light projector to linearly irradiate a work, a mirror 
driving means to rock the mirror at a predetermined pitch in a direction where a 
moving locus of the irradiation is orthogonal to the linear irradiation, a camera to 
take a picture of the work at each rocking position of the mirror by maintaining a 
predetermined position with respect to the mirror, and an image processing unit 
to find a projection/recess shape of the work by storing values which indicate 
rocking angles of the mirror for laser beam detecting positions on a camera 
coordinate system for which the linear direction of the irradiation and the direction 
of a moving locus of the irradiation are two orthogonal axes. A projection/recess 
shape of a perfect work is found and then stored by the image processing unit in 
advance. Then, a projection/recess shape of an inspected work is found by the 
image processing unit. The presence/absence of a defect on the inspected work 
is inspected by comparing, at each matrix element, a value indicating a rocking 
angle of the mirror stored for the perfect work to a value indicating a rocking angle 
of the mirror stored for the inspected work. In order to achieve the object above, 
in particular, a difference is found between a value indicating a rocking angle of the 
mirror stored for the perfect work and a value indicating a rocking angle of the 
mirror stored for the inspected work, at each matrix element. This difference is 
stored for each matrix element. A most frequent difference value is found among 
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matrix elements in a linear direction of the irradiation for each column of the 
matrix elements arranged in a direction of the irradiation. Matrix elements having 
differences deviating from the most frequent difference value by more than a set 
level are found at each column of the matrix elements. These elements are stored 
as defect candidates. Then, the presence/absence of defects on the inspected work 
is determined based on all the existing states of the matrix elements as defect 
candidates on the matrix. 

Subsequently, the principles of how the invention solves the conventional 
problems will be explained. 

First, a light projector, a mirror driving means, a camera, and an image 
processing unit are operated. As in the conventional art, the projection/recess 
shape of a perfect work is found and then stored by storing values indicating 
rocking angles of the mirror, in other words, distance codes, for a matrix of a 
camera coordinate system for which the linear direction of the irradiation and the 
moving locus of the irradiation are two orthogonal axes. Accordingly, a distance 
code image shown in, for instance, Fig. 7(a) is obtained as a reference. 

Subsequently, as mentioned above, the light projector, the mirror driving 
means, the camera, and the image processing unit are operated repeatedly. A 
distance code is stored for a matrix of a camera coordinate system for which the 
linear direction of the irradiation and the moving locus of the irradiation are two 
orthogonal axes, and the projection/recess shape of the inspected work is found. 
Accordingly, a distance code image shown in, for example, Fig. 9(a) is obtained. 
Normally, environmental temperature is different from the temperature when the 
distance code image was obtained as a reference. Thus, the distance code image 
shown in Fig. 9(a) has an error in distance codes due to a positional shift of the 
mirror or a detection error (nonlinear shift, origin drift, or the like) of rocking 
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positions caused by temperature drift or the like of a rotating position detecting 
means for detecting the rocking position of the mirror. 

Subsequently, the difference between the distance codes of the perfect 
work and the distance codes of the inspected work at each matrix element for 
which the direction of the irradiation and the direction of a moving locus of the 
irradiation are two orthogonal axes. This difference is then stored for each matrix 
element. Accordingly, a differential distance code image shown in, for example, 
Fig. 9(b) is obtained. Since the distance code image of the inspected work has an 
error by itself the difference values of distance codes increase toward the end of 
the work, as shown in Fig. 8(c). 

However, the distance code image of the inspected work has errors 
because of the drift of rocking angles of the mirror or the erroneous recognition 
of rocking angles. Thus, the distance codes stored for matrix elements in the same 
column in the direction of irradiation should all have equal errors. For instance, 
when the work 2 shown in Fig. 8(a) is inspected, the distance code data at the end 
of the work 2 measured at the reference temperature is shown as a broken line in 
Fig. 8(d) where the horizontal axis is the linear direction (X-axis direction) of 
irradiation. Moreover, the distance code data at the end of the work 2 measured 
at a temperature higher than the reference temperature is shown as a solid line in 
Fig. 8(d). Thus, either the distance code data of the work 2 measured at the 
reference temperature or the distance code data of the work 2 measured at a 
temperature higher than the reference temperature is shifted, and both are 
overlapped as shown in Fig. 8( e). Then, the presence/absence of a surface defect 
is found by determining the presence/absence of mismatching distance code data 
at each position in the column of matrix elements in the direction of irradiation 
(X-axis direction). 
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First, most frequent difference values are found at each column of matrix 
elements arranged in the direction of the irradiation, among matrix elements in the 
linear direction of the irradiation. When the inspected work 2 has no defects on 
its surface, both should match completely, as in Fig. 8(e), when the distance code 
data of the work 2 measured at the reference temperature is overlapped with the 
distance code data of the work 2 measured at a temperature higher than the 
reference temperature. In this case, all the difference values found in matrix 
elements in the linear direction of irradiation are equivalent to AZ. It is obvious 
that differences other than AZ are sometimes detected when the work 2 has a 
projection/recess defect on its surface. However, since the surface of the work 2 
is not normally severely damaged, most frequent differences in matrix elements in 
the linear direction of the irradiation are always equivalent to AZ in Fig. 8(d). This 
AZ is equivalent to a shift quantity. Furthermore, AZ because a distance code 
error itself due to a positional shift of the mirror or a detection error (nonlinear 
shift, origin drift, or the like) caused by temperature drift or the like of a rotating 
position detecting means for detecting the rocking position of the mirror. 

Subsequently, matrix elements having differences which deviate from the 
most frequent difference value (AZ) by more than a set value are found at each 
column of matrix elements arranged in the direction of the irradiation, and are 
stored as defect candidates. The matrix element section having differences 
deviating from the most frequent difference value ( AZ) by more than a set value 
is a section where the distance code data of the work measured at the reference 
temperature and the distance code data of the work measured at a temperature 
higher than the reference temperature do not match each other, even by shifting the 
distance code data. This indicates that the section has projection/recess defects. 

Finally, the presence/absence of defects on an inspected work is determined 
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in accordance with the existing state of all matrix elements which is defect 
candidates on a matrix That is, all the defect candidates within a projection plane 
of the work for which the linear direction of irradiation and the direction of a 
moving locus of irradiation are found along two orthogonal axes. For instance, 
when a point defect candidates are found, it is considered to be simply a 
measurement mistake. It is also possible to determine that a work has no 
abnormality. When defect candidates are close to each other over a certain area, 
it is possible to clearly determine that they are surface defects. 

Therefore, the scale (AZ) of a distance-measuring code error caused by a 



Q 10 position shift of the mirror or a detection error (nonlinear shift, origin drift, or the 

yl 

(jf) like) due to temperature drift or the like of a rotating position detecting means for 

ijj 

• » detecting the rocking position of the mirror is found. Then, a test is performed to 

f determine whether or not the distance code data of the work measured at the 

flj reference temperature match the distance code data of the work measured at a 

ipl 15 temperature higher than the reference temperature by shifting the distance code 

) data by an amount equivalent to an error. Accordingly, appropriate defect 



inspection can always be performed independently of temperature differences 
during measurement. 

The problems are solved as described above even when the measurement 

20 is performed at a temperature lower than the reference temperature. 

In order to achieve the same object as above for each projection/recess 
shape of a perfect work and projection/recess shape of an inspected work, a value 
which indicates a most frequent rocking angle of a mirror is found among matrix 
elements in the linear direction of irradiation at each column of matrix elements 

25 arranged in the direction of irradiation. In order to match the values that indicate 
most frequent rocking angles of a mirror in the projection/recess shape of a perfect 
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work and projection/recess shape of an inspected work, the values for the 
inspected work are shifted at each column of matrix elements arranged in the 
direction of irradiation. Then, the values indicating rocking angles of the mirror 
that are stored for the perfect work are compared, at each matrix element, with the 
5 values indicating rocking angles of the mirror that are stored for the inspected 
work, so as to detect the presence/absence of defects on the inspected work. 

In this case, the values indicating the most frequent rocking angles of a 
I Z mirror are equivalent to a straight line having the maximum length in the linear 

P direction of irradiation on a work. (However, this is based on the assumption that 

(*•'") 

ijj 10 the straight line is orthogonal to the optical axis of a camera.) Thus, this straight 

m 

? ^ line is specified at each perfect work and an inspected work. Then, the data values 

M indicating rocking angles of a mirror are shifted and compared at each column of 



U,i matrix elements arranged in the direction of irradiation so as to overlap these 

straight lines. This permits proper detection of defects regardless of temperature 
vll 15 differences during measurement. This shift quantity is equal to the scale (AZ) of 



a distance code error caused by the above-mentioned position shift of the mirror 
or error (nonlinear shift, origin drift, or the like) due to temperature drift or the like 
of a rotating position detecting means for detecting the rocking position of the 
mirror. 

20 The above, and other objects, features and advantages of the present 

invention will become apparent from the following description read in conjunction 
with the accompanying drawings, in which like reference numerals designate the 
same elements. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a functional block diagram, showing a schematic configuration of 
a defect inspection device required to carry out a defect inspection method of a 
three-dimensional shape according to the present invention. 

Fig. 2 is a functional block diagram, showing a schematic configuration of 
an image processing unit in the defect inspection device. 

Fig. 3 is a flow chart showing schematic operations of the image processing 
unit in the defect inspection device. 

Fig. 4(a) is a conceptual diagram of an inspection window in order to 
specify differential data to be extracted from a differential distance code image. 

Fig. 4(b) is a conceptual diagram showing a visualized defect extracting 
image which is obtained by the image processing unit in the defect inspection 
device. 

Fig. 5 is a conceptual diagram showing an example of sorting extracted 
differential data. 

Fig. 6(a) is a conceptual diagram to which reference will be made in 
explaining the principle of a conventional defect inspection method of a 
three-dimensional shape. 

Fig. 6(b) is a conceptual diagram to which reference will be made in 
explaining problems found in the conventional defect inspection method of a 
three-dimensional shape. 

Fig. 7(a ) is a conceptual diagram showing one example of a distance code 
image as a reference that is obtained by the conventional defect inspection method 
of a three-dimensional shape. 
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Fig. 7(b) is a conceptual diagram showing one example of a distance code 
image containing a defect that is obtained by the conventional defect inspection 
method of a three-dimensional shape. 

Fig. 7(c) is a conceptual diagram showing one example of a differential 
distance code image that is obtained by the conventional defect inspection method 
of a three-dimensional shape. 

Fig. 7(d) is a conceptual diagram showing one example of a defect 
extracting image that is obtained by the conventional defect inspection method of 
a three-dimensional shape. 

Fig. 8(a) is a plan view, showing one example of the shape of a work from 
which a distance code image is obtained. 

Fig. 8(b) is a conceptual view, showing a work shape which is shown by 
extracted distance codes by scanning the work at a reference temperature, by 
adjusting the distance codes. 

Fig. 8(c) is a conceptual view showing a work shape which is shown by 
extracted distance codes by scanning the work at a temperature higher than the 
reference temperature, by adjusting the distance codes. 

Fig. 8(d) is a conceptual view, to which reference will be made in 
explaining conventional problems and some of the basic principles of the present 
invention. 

Fig. 8(e)isa conceptual view to which reference will be made in explaining 
some of the basic principles of the present invention. 

Fig. 9(a) is a conceptual view, showing one example of a distance code 
image generated on the basis of distance codes that are extracted by scanning a 
work at a temperature higher than a reference temperature. 

Fig. 9(b) is a conceptual view showing one example of a differential 
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distance code image which is obtained by comparing a distance code image 
generated at the reference temperature and a distance code image generated at a 
temperature higher than the reference temperature. 

Fig. 9( c) is a conceptual view showing one example of a defect extracting 
5 image obtained from a differential distance code image by the con ventio nal defect 
inspection method of a three-dimensional shape. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring to Fig. 1, a defect inspection device 7 has a light projector 1 
ill irradiating a laser beam A mirror 3 reflects the laser beam from the light projector 

m 

y j 10 1 to linearly illuminate a work 2 in the direction of an X-axis in Fig. 1 . A galvano 

' scanner 8 drives the mirror 3 with a rocking motion at a predetermined pitch in the 

W direction where the moving locus of the irradiation is orthogonal to the linear 

m 

p radiation. That is, the rocking motion moves the impact point of the beam in the 

m 

;; r ! direction of the irradiation toward a Y-axis in Fig. 1 . A rotating position detecting 

W 15 sensor 9, attached to the galvano scanner 8, detects the rocking position of the 

mirror 3. A camera 4 to take a picture of the work 2 at each rocking position of 
the mirror 3 by maintaining a relative position with respect to the mirror 3. A 
work mounting table 1 1 receives the work 2 on its surface. 

The light projector 1, the galvano scanner 8 and an image processing unit 
20 10 which is also a drive control means of the camera 4, detect the projection/recess 

shape of a surface of the work 2 by repeatedly executing a process to store values 
indicating the rocking angles of the mirror 3 (distance codes) in response to laser 
beam detecting positions on a camera coordinate system of the camera 4, while 
rocking the mirror 3 so as to store the distance codes in response to a matrix (X, 
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Y) on the camera coordinate system for which the linear direction (X-axis 
direction) of the irradiation and the direction of a moving locus (Y-axis direction) 
of the irradiation are two orthogonal axes. 

The light projector 1, the mirror 3, the camera 4 and the galvano scanner 
8 as a mirror driving means have the same configurations and functions as those 
in the conventional example shown in Fig. 6(a). Thus, a detailed description 
thereof is omitted. 

The image processing unit 1 0 also has the same configuration as that of the 
image processing unit 5 of the conventional example shown in Fig. 6(a), except for 
an internal processor and memory. 

Fig. 2 is a functional block diagram, showing a schematic configuration of 
the image processing unit 10. The figure also shows the electrical connections of 
the light projector 1, the galvano scanner 8, the rotating position detecting sensor 
9, and the image processing unit 10. 

As shown in Fig. 2, the image processing unit 10 has a CPU 12 for 
arithmetic processing, a ROM 13 containing a control program of the CPU 12, a 
nonvolatile memory to store a projection/recess shape of the perfect work 2, and 
a RAM 15 used for temporary storage or the like of arithmetic data. The storage 
region of the RAM 15 is used as a differential distance code image storage section 
15a, a buffer section 15b, a label image storage section 15c, a distance code image 
storage section 15d, a reference distance code image storage section 15e. RAM 
15 may also contain other functions (not shown or enumerated). 

The light projector 1, the camera 4 and the galvano scanner 8 are each 
driven and controlled by the CPU 12 through driver circuits 16, 17 and 18 and an 
input-output circuit 19. The rotating position of the galvano scanner 8, which 
corresponds to the rocking position of the mirror 3, is detected by the rotating 
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position detecting sensor 9. An A/D converter 20 produces a digital equivalent of 
the rotating position for connection through the input-output circuit 1 9 to the CPU 
12. 

The origin (or zero position) of the galvano scanner 8 sometimes shifts due 
to temperature differences. Even in the inspection precision of the rotating 
position detecting sensor 9 itself a nonlinear shift is sometimes found due to 
temperature changes. In a strict sense, it is not possible to say that the CPU 1 2 can 
accurately recognize the rocking position of the mirror 3. 

As explained in the conventional art by referring to Fig. 6(a) and Fig. 6(b), 
an error is caused between actual levels of distance codes and levels of distance 
codes that the image processing unit 10 recognizes, due to a shift of rocking 
positions of the mirror due to temperature changes, or a detection error caused by 
temperature drift or the like of the rotating position detecting sensor 9 to detect 
the rocking position of the mirror 3. 

A display device 22 is connected to the input-output circuit 19 of the CPU 
12 through a driver circuit 21. The display device 22 displays the final 
determination results of surface defects of the work 2 found by the arithmetic 
processing in the CPU 12. 

A manual data input device 23 (MDI) constitutes a man-machine interface 
between the image processing unit 10 and an operator. The manual data input 
device 23 is used for starting the image processing unit 1 0, inputting measurement 
instructions and the like. 

The defect inspection method of a three-dimensional shape in the 
embodiment will be explained in detail by referring to the configurations and the 
flow chart in Fig. 3. 

First, in preparation for determining defects on the surface of the inspected 
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work 2, an operator stores a projection/recess shape of the perfect work 2 into the 
image processing unit 10 of the defect inspection device 7. 

Specifically, an operator first places the perfect work 2 on a predetermined 
position of the work mounting table 1 1 in the defect inspection device 7, and 
inputs measurement instructions for reference data input by operating the manual 
data input device 23. 

The image processing unit 1 0 detects the input of measurement instructions 
for reference data input and drives and controls the light projector 1, the camera 
4 and the galvano scanner 8. As in the , conventional art, the unit stores a 
projection/recess shape of the perfect work 2 into the nonvolatile memory 14 of 
the image processing unit 10 as a distance code image which becomes a reference, 
as shown in Fig. 7(a). The temperature (air temperature) that exists when a 
projection/recess shape of the perfect work 2, defined as the reference 
temperature, is stored by the reference data input processing. This reference 
temperature must be within a temperature range to properly operate the defect 
inspection device 7. However, as long as the reference is within the range, there 
is no particular limitation. For example, even when there is a slight shift from the 
origin of the mirror 3 or a slight temperature drift or the like of the rotating 
position detecting sensor 9, there is practically no hindrance. 

In the embodiment, a value of X-axis coordinates at each position where 
the length of the irradiation 24 on the work 2 in a linear direction is divided by n 
is considered to be a matrix element i, to i, on a camera coordinate system. A 
value of Y-axis coordinates at each position in which an distance of rocking 
positions where the laser irradiates from the left end to the right end of the work 
2 is divided by m is considered to be a matrix element j, to L on a camera 
coordinate system in other words, there are n x m matrix elements (i„ j,) to (i,, 
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to L) in the overall matrix. 

The distance code value indicating the rocking angle of the mirror 3 is 255 
(which corresponds to white in a gray scale) when the laser beam irradiates the left 
end of the work 2 at the reference temperature, and the value is 0 (which 
corresponds to black in a gray scale) when laser beam irradiates the right end of 
the work 2 at the reference temperature. 

The image processing unit 10 stores rocking angles of the mirror 3 in 
response to the matrix of a laser beam detecting position on a camera coordinate 
system of the camera 3, in other words, distance codes. Thus, when there is a 
plane standing vertically on the work 2, that is, when the detection position of the 
laser beam within an X- Y plane does not change as the rocking angle of the mirror 
3 changes, different distance codes are stored on the same matrix. In this case, a 
value which is finally stored in response to this matrix, is a distance code which is 
input at the end. 

Fig. 7(a) is an image when a distance code value stored at each matrix 
element of (^ ( X = i ton> jy <y = i to m)) on a camera coordinate system is visualized as 
gray-scale density as the defect inspection device 7 is started at the reference 
temperature. This image is a distance code image as a reference. 

However, the distance code image in Fig. 7( a ) is simply visualized data for 
convenience of explanation. The distance code image is dealt with simply as 
numeric data for the internal processing of the image processing unit 10. Even a 
reference distance code image stored in the nonvolatile memory 14, in other 
words, data expressing a projection/recess shape of the perfect work 2, is numeric 
data of a three-dimensional array. It is not particularly necessary to display the 
distance code image of Fig. 7(a) on the display device 22. 

The work 2 used for generating the distance code image as a reference is 
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removed from the work mounting table 1 1 after operation. 

Subsequently, in order to inspect defects on the surface of the inspected 
work 2, an operator similarly places the inspected work 2 on the work mounting 
table 11, and operates the manual data input device 23 to input measurement 
5 instructions for the defect inspection. 

After reading a reference distance code image obtained from the perfect 
work 2 from the nonvolatile memory 14 into the reference distance code image 
storage section 15e of the RAM 15 (step SI), the image processing unit 10 which 
detected the input of measurement instructions for defect inspection drives and 
10 controls the light projector 1, the camera 4, and the galvano scanner 8 for the 
above-mentioned reference data input processing. Then, the unit stores a 
projection/recess shape of the inspected work 2 into the distance code image 
storage section 1 3d of the RAM 1 5 as a distance code image, as shown in Fig. 9(a) 
(step S2). 

15 The data array of a distance code image is exactly the same as the data 

array of the above-mentioned distance code image as a reference, so that the 
explanation thereof is omitted. However, differences are often found between 
distance codes stored as a distance code image and distance codes stored as a 
reference distance code image on the same matrix due to temperature changes or 

20 the like even if the shape of the inspected work 2 is perfect. 

Subsequently, the image processing unit 10 finds the difference between a 
reference distance code image obtained from the perfect work 2 and a distance 
code image obtained from the inspected work 2 at each matrix element of (^ (x= t 
to n>> Jy (y = i to m>) Th e unit then temporarily stores each difference value into the 

25 differential distance code image storage section 15a of the RAM 15 for each 
matrix element of (i x(x = lton) , j y(y=ltom) ) (step S3). 
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If the scale of differences of distance codes is visualized as a gray-scale 
density as described above, a differential distance code image shown in Fig. 9(b), 
for instance, would be obtained. However, it is actually unnecessary to visualize 
a differential distance code image and display it on the display device 22. 

Subsequently, the image processing unit 10 sets up an inspection window 
as shown in Fig. 4(a) at the differential distance code image storage section 15a 
( step S4 ). All the difference values contained in the inspection window are copied 
into the buffer section 15b of the RAM 15 (step S5). The content of the 
differential distance code image in Fig. 4(a) is the same as that of the differential 
distance code image in Fig. 9(b). The inspection window in Fig. 4(a) is conceptual 
like the distance code image and differential distance code image mentioned above, 
and is not actually displayed on the display device 22. In reality, each differential 
data for one vertical column which is equivalent to the matrix (i„ j,) to (i,,, j,) on 
the camera coordinate system, is extracted into the buffer section 15b by the 
processing of the above-mentioned step S4 and initially executing step S5. 

Then, the image processing unit 10 performs an ascending or descending 
sorting process on all the differential data extracted to the buffer section 15b, to 
find a median of most frequent differential data (step S6). 

Fig. 5 shows one example of differential data which was sorted at step S6. 
In the example of Fig. 5, approximate differences are most frequently found 
between al and a2. Approximate differences are also frequently found between 
bl and b2. In order to simplify arithmetic processing, a median a n of most frequent 
differences between a 1 and a2 is defined as a most frequent difference value herein. 

The median a 0 , as described above, is (Z value, in other words, an error of 
distance codes caused by a position shift of the mirror 3 or a detection error 
(nonlinear shift, origin drift or the like) due to temperature drift or the like of the 
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rotating position detecting sensor 9 for detecting the rocking position of the mirror 
3. Jf a surface shape of the inspected work 2 is perfect, distance codes obtained 
from the inspected work 2 should perfectly match distance codes of a reference 
distance code image as all the distance codes are shifted for one vertical column 
by the most frequent difference value a 0 (= AZ). 

Then, the image processing unit 1 0 retrieves information on whether or not 
there are matrix elements having differences which deviate from the most frequent 
difference value a 0 by more than a threshold value (for instance, set value, AS, in 
Fig. 5) in the buffer section 15b. If there are, the image processing unit 10 labels 
the matrix elements having those differences and stores them as defect candidates 
(step S7). 

This labeling is, specifically, achieved by setting defect candidate flags at 
corresponding positions of defect candidates in the label image storage section 15c 
of the RAM 15 where the storage of n-row by m- column matrix elements is 
permitted, like the differential distance code image storage section 15a. For 
instance, if difference values at the (14, jl) point and the (is, jl) point in a 
differential distance code image are contained at an distance between bl and b2 in 
Fig. 5, defect candidate flags would be set at the (i4, j 1) point and the (is, jl) point 
in the label image storage section 15c. The sections where the defect candidate 
flags are set are sections where distance codes obtained from the inspected work 
2 does not match distance codes of a distance code image as a reference even by 
shifting the distance code data by the above-mentioned difference a 0 (= (Z). In 
other words, the sections indicate that the surface of the work 2 may have defects. 

This labeling is essentially the same as the procedure in which a difference 
in both shapes is detected by overlapping a shape of the work 2 having no defects 
observed at the reference temperature with a shape of the inspected work 2 
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observed at a temperature higher or lower than the reference temperature, as 
shown in, for example, Fig. 8(e). 

Subsequently, the image processing unit 10 determines whether or not the 
detection processing of defect candidates is finished for all the differences stored 
in the differential distance code image storage section 15 a, in other words, whether 
or not the above-mentioned steps S5 to S7 are taken for all the columns j = 1 to 
m (step S8). If the detection processing is not yet completed, the setting position 
of the inspection window is shifted in the column direction, in other words, the 
right direction in Fig. 4(a) (step S9). As described above, the steps S5 to S7 are 
repeatedly executed until all columns are scanned. 

Finally, when the detection processing of defect candidates is completed 
for all the columns j = 1 to m, the image processing unit 10 determines the 
presence/absence of defects of the inspected work 2 based on the existing state of 
all the labeled matrix elements. That is, the set/non-set state of defect candidate 
flags in the label image storage section 15c. Then, the unit displays the results on 
the display device 22 to notify an operator (step S10). 

Fig. 4(b) shows one example of the ON/OFF state of defect candidate flags 
set on the label image storage section 1 5 c by the repetition of the above-mentioned 
steps S5 to S7. The image is called a defect extracting image herein. This defect 
extracting image is also conceptual as described above. Fig. 4(b) visualizes the 
ON/OFF states of defect candidate flags by showing a section where a defect 
candidate flag is set in white, or a section where a defect candidate flag is not set 
in black. In the example of Fig. 4(b), white sections where defect candidate flags 
are set are scattered over a small area. As a result, the image processing unit 10 
determines that the inspected work 2 has no defects, and displays a statement such 
as "no abnormality" on the display device 22. 
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When white sections where defect candidate flags are set are continuously 
found over an area larger than a certain level, a statement such as "defective" is 
displayed. 

It is also possible to determine the presence/absence of defects by taking 
into account the whole shape of sections where defect candidate flags are set, in 
addition to the size of an area where defect candidate flags are set. For example, 
when the sections where defect candidate flags are set have a length greater than 
a certain value in each axis direction, this may be taken as an indication that the 
work 2 contains surface defects. 

As clearly seen in a comparison between a defect extracting image in Fig. 
4(b) obtained by the processing in the embodiment and a defect extracting image 
in Fig. 9(c) obtained by the conventional art, the embodiment prevents a 
determination mistake which results from an error of distance codes caused by a 
position shift of the mirror 3 or a detection error (nonlinear shift, origin drift or the 
like) due to temperature drift or the like of the rotating position detecting sensor 
9 for detecting the rocking position of the mirror 3. The presence/absence of 
surface defects on the work 2 is properly determined. 

The reason is, as described above, that a procedure is digitally executed for 
detecting a difference in both shapes by overlapping the shape of the work 2 
having no defects observed at the reference temperature with the shape of the 
inspected work 2 observed at a temperature higher or lower than the reference 
temperature. 

In the following, an embodiment is briefly explained. In the embodiment, 
most frequent distance codes are found among matrix elements in the linear 
direction of the radiation 24. That is, in the X-axis direction, at each rocking 
position of the mirror 3 for each projection/recess shape of the perfect work 2 and 
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the projection/recess shape of the inspected work 2. Distance codes obtained for 
inspected work 2 are shifted at each rocking position of the mirror 3 so as to 
match the most frequent distance codes in the projection/recess shape of the 
perfect work 2 and projection/recess shape of the inspected work 2. Then, 
distance codes obtained from the perfect work 2 are compared with distance codes 
obtained from the inspected work 2 at each matrix element, so as to inspect the 
presence/absence of defects of the inspected work 2. 

In this embodiment, first, the perfect work 2 is scanned by the defect 
inspection device 7 to produce a distance code image as a reference (as illustrated, 
for example in Fig. 7(a)). The distance code image is stored in the reference 
distance code image storage section 15e. The inspected work 2 is then scanned 
by the defect inspection device 7 to produce a distance code image as a reference 
(as illustrated, for example, in Fig. 9(a)). This image is stored in the distance code 
image storage section 15d. 

Then, an inspection window as shown in Fig. 4(a) is set up by the image 
processing unit 10 at the reference distance code image storage section 15e. 
Distance codes of matrix elements equivalent to (i„ j,) to (i„, j,) are extracted, and 
an ascending or descending sorting process is performed for all the extracted 
distance codes to find the most frequent distance codes. From the sorting results, 
the data shown in Fig. 5 are obtained. In this case, a group of most frequent 
distance codes is found only for the number of planes that are orthogonal to the 
optical axis of the camera 4. For instance, regarding an A- A 1 position shown in 
Fig. 8(a) for the work 2, a surface 2d, a flat part 2c, and the bottom section of the 
peripheral groove 2a become X, Y coordinates having frequent distance codes. 
Since the height of an inclined surface 2e is inconsistent, data from such an inclined 
surface does not become a frequent distance code. Moreover, a peripheral groove 
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2b is located in two dot shapes that are scattered at two locations. Thus, the area 
thereof is extremely small, and the groove does not provide coordinates having 
frequent distance codes. Most frequent distance codes in the example of Fig. 8(a) 
and Fig. 8(d) are distance codes which are stored for coordinates of the flat part 
2c (straight line having the maximum length in the linear direction of the irradiation 
on the work 2). A distance code equivalent to a reference surface of the normal 
work 2 as a reference (shape shown with a broken line in Fig. 8(d)) is specified 
based on the height of the flat part 2c. 

The image processing unit 10 sets up an inspection window as shown in 
Fig. 4(a) at the distance code image storage section 15d. Then, distance codes of 
matrix elements equivalent to (i l9 j,) to ft,, j,) are extracted. An ascending or 
descending sorting process is performed for all the extracted distance codes, as 
described above, to find the most frequent distance codes. As mentioned above, 
a distance code value equivalent to a reference surface of the inspected work 2 
(shape shown with a solid line in Fig. 8(d)) is specified based on the height of the 
flat part 2c which consists of a straight line having the maximum length in the 
linear direction of irradiation on the work 2 

Subsequently, most frequent distance code values of the inspected work 
2 are deducted from most frequent distance code values of the perfect work 2, thus 
finding a distance code difference AZ as shown in Fig. 8(d). This AZ, value is an 
error of distance codes, equivalent to a position shift of the mirror 3 or a detection 
error (nonlinear shift, origin drift, or the like) due to temperature drift or the like 
of the rotating position detecting sensor 9 for detecting a rocking position of the 
mirror 3. 

Then, the difference AZ is added to each distance code of (i„ j,) to(i, j,) 
which was extracted from the distance code image storage section 15d. (In this 
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embodiment, AZ has a minus sign.) Distance code values obtained from the 
inspected work 2 are all shifted, and are again written into the distance code image 
storage section 15d. Due to this procedure, a projection/recess shape of the 
perfect work 2 and a projection/recess shape of the inspected work 2 actually 
overlap each other at the flat part 2c as a reference as shown in, for instance, Fig. 
8(e). 

The above-mentioned procedure is repeatedly executed for all the data 
arrays j, to L in the distance code image storage section 15d. Thus, an error AZ 
of a distance code that is characteristically found at each rocking position is found 
at each rocking position of the mirror 3. Distance code values obtained from the 
inspected work 2 are shifted only by the error AZ, and then re-loaded into the 
distance code image storage section 15d. 

Finally, the presence/absence of defects on the surface of the inspected 
work 2 is determined by a comparison between distance codes obtained from the 
perfect work 2 and distance code values (whose data has already been shifted) 
obtained from the inspected work 2. 

In this embodiment, a reference surface for alignment is a surface 
containing a straight line which has the maximum length in the linear direction of 
the irradiation on the work 2, in other words, a straight surface containing the 
coordinates which have most frequent distance-measuring codes in a plurality of 
matrix elements having an identical Y-axis value. Thus, a reference surface can 
often be the flat section 2c or the surface 2d, depending on the position of the 
irradiation. However, the reference surface equally and simultaneously changes 
at the reference distance code image storage section 15e and the distance code 
image storage section 15d, so that there is no problem for comparison. 

Even in this embodiment, like the initially explained embodiment, a 
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difference in both shapes is actually detected by overlapping a shape of the work 
2 having no defects observed at the reference temperature, with a shape of the 
inspected work 2 observed at a temperature higher or lower than the reference 
temperature. Thus, it is possible to prevent an error of distance codes caused by 
a position shift of the mirror 3 or a detection error (nonlinear shift, origin drift or 
the like) due to temperature drift or the like of the rotating position detecting 
sensor 9 for detecting the rocking position of the mirror 3. The presence/absence 
of surface defects of the work 2 is appropriately determined. 

In the defect inspection method of a three-dimensional shape according to 
the present invention, differences are found between values indicating rocking 
angles of a mirror which are equivalent to distances between a perfect work and 
a camera, and values indicating rocking angles of the mirror which are equivalent 
to distances between an inspected work and the camera. The differences are 
stored in a matrix for which the linear direction of the irradiation and the direction 
of a moving locus of the irradiation are two orthogonal axes. The most frequent 
difference value among matrix elements in the linear direction of the irradiation is 
found at each rocking position. Matrix elements having differences that deviate 
from the most frequent difference by more than a set value are found. 
Accordingly, the method detects sections where the values indicating rocking 
angles of the mirror which are equivalent to distances between a perfect work and 
the camera and the values indicating rocking angles of the mirror which are 
equivalent to distances between an inspected work and the camera do not match 
each other even by relatively shifting the values indicating rocking angles of the 
mirror. The detected sections are stored as defect candidates. Furthermore, the 
method determines the presence/absence of defects of an inspected work based on 
all the existing states of matrix elements that could be defect candidates on a 
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matrix. Thus, even when the precision of the rocking position of the mirror and 
the rotating position detecting means for detecting the rocking position of the 
mirror is reduced due to temperature changes, the method accurately determines 
the presence/absence of defects on the surface of an inspected work. 

Moreover, the method determines the presence/absence of defects on the 
surface of an inspected work by finding values indicating most frequent rocking 
angles of the mirror among matrix elements in the linear direction of the irradiation 
at each column of matrix elements arranged in the direction of the irradiation for 
each projection/recess shape of a perfect work and each projection/recess shape 
of an inspected work. The values indicating rocking angles of the mirror obtained 
from the inspected work at each column of matrix elements arranged in the 
direction of the irradiation are shifted so as to match the values indicating the most 
frequent rocking angles of the mirror in the projection/recess shape of the perfect 
work and the projection/recess shape of the inspected work. Then, the method 
practically overlaps the projection/recess shape of the perfect work with the 
projection/recess shape of the inspected work. Thus, even when the precision of 
the rocking position of the mirror and the rotating position detecting means for 
detecting the rocking position of the mirror is reduced due to temperature changes, 
the method accurately determines the presence/absence of defects on the surface 
of an inspected work. 

As a result, defect inspection is accurately executed on the surface of a 
work without changing settings so as to accurately execute the defect inspection, 
and without actively controlling the temperature of the environment. Operations 
for defect inspection are simplified, and additional facilities to improve the 
inspection precision are unnecessary. Costs for plant and equipment investment 
are also reduced. 



* 
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Having described preferred embodiments of the invention with reference 
to the accompanying drawings, it is to be understood that the invention is not 
limited to those precise embodiments, and that various changes and modifications 
may be effected therein by one skilled in the art without departing from the scope 
or spirit of the invention as defined in the appended claims. 



